Internal Usability Testing of Automated Essay Feedback in an Intelligent Writing Tutor
نویسندگان
چکیده
Research on automated essay scoring (AES) indicates that computer-generated essay ratings are comparable to human ratings. However, despite investigations into the accuracy and reliability of AES scores, less attention has been paid to the feedback delivered to the students. This paper presents a method developers can use to quickly evaluate the usability of an automated feedback system prior to testing with students. Using this method, researchers evaluated the feedback provided by the Writing-Pal, an intelligent tutor for writing strategies. Lessons learned and potential for future research are discussed.
منابع مشابه
Enhancing an Automated Braille Writing Tutor
The reported work advances the state-of-the-art in assistive technology for the blind by enhancing a low-cost automated tutor designed to teach braille writing skills to visually impaired children using voice feedback. We first provide some background on how the methodology of Intelligent Tutoring Systems correlates to an automated tutor for teaching braille writing skills. We then build on pri...
متن کاملDeveloping Pedagogically-Guided Threshold Algorithms for Intelligent Automated Essay Feedback
Current computer-based tools for writing instruction show high scoring accuracy but uncertain instructional efficacy. One explanation is that these systems may not effectively communicate valid and appropriate formative feedback. In this paper, we describe an exploratory method for developing feedback algorithms that are grounded in writing pedagogy. The resulting threshold algorithms are shown...
متن کاملThe Effect of Writing Feedback Techniques and Students’ Writing Anxiety on Students’ Essay Writing Ability
The Research was aimed at finding out the effects of the implementation of writing feedback techniques and students’ writing anxiety on students’ writing ablity. Experimental method of 3x2 factorial design was employed in the research. There were three experimental groups of students who were taught by using teacher feedback, peer feedback and the combination of peer and teacher feedback writin...
متن کاملThe Effect of Writing Feedback Techniques and Students’ Writing Anxiety on Students’ Essay Writing Ability
The Research was aimed at finding out the effects of the implementation of writing feedback techniques and students’ writing anxiety on students’ writing ablity. Experimental method of 3x2 factorial design was employed in the research. There were three experimental groups of students who were taught by using teacher feedback, peer feedback and the combination of peer and teacher feedback writin...
متن کاملDeveloping pedagogically-guided algorithms for intelligent writing feedback
Various computer tools have been developed to support educators’ assessment of student writing, including automated essay scoring and automated writing evaluation systems. Research demonstrates that these systems exhibit relatively high scoring accuracy but uncertain instructional efficacy. Students’ writing proficiency does not necessarily improve as a result of interacting with the software. ...
متن کامل